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<54) Display system with spatial light modulator with decompression of Input image signal 



(57) Psn alkJigital television system (10). espedally 
designed for receiving and interpreting advanced televi- 
sion (ATV) signals. Ttie system (10) uses a multiproces- 
sor unit (12) for perlorming decompression and a serial 
video processor (13) for scaling. A picture quality unit 
(14) performs colorspace conversion and de-gamma. A 



bit-plane buffer formats and stores bit-plane data. The 

display devices are three spatia) light modulators 
(SLMs) (16), each of which generate a red, gr^en, or 
blue image. The images are combined by an optics unit 
(1 7) for full-color full-motion displays. 
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Description 

TECHNICAL FIELD OF THE INVENTION 

This invention relates to image display systems, 
and more particularly to a digital image display system 
for displaying images from advanced television signals, 
namely standard definition television (SDTV) or high 
definition television (HDTV) signals. 



BACKGROUND OF THE INVENTION 

Video display systems based on spatial light modu- 
lators (SLMs) are inaeasingly being used as an alterna- 
tive to display systems using cathode ray tubes (CRTs). 
SLM systems provide high resolution displays wrthout 
the bulk and power consumption of CRT systems. They 
are all-digital, with both digital processing and display. In 
other words, a digital input signal can be received, or an 
analog signal can be received and digitized, with subse- 
quent processing and display of the data in digital form. 

Digital micro-mirror devices (DMDs) are a type of 
SLM. and may be used for projection display applica- 
tions. A DMD has an array of miao^echanical display 
elements, each having a tiny mirror that is individually 
addressable with an electronic signal. Depending on the 
state of its addressing signal, each mirror lilts so that it 
either does or does not reflect light to the image plane. 
The mirrDrs are often referred to as "pixels", to corre- 
spond to the pixels of the image they generate, but they 
are more correctly refen-ed to as "display elements^ 
Generally, displaying pixel data is accomplished by 
loading memory cells connected to the display ele- 
ments. Each memory cell receives one bit of data repre- 
senting an -ON" or "OFF" state of a display element 
The display elements canmaintain their "ON * or "OFF " 
state for controlled display times. 

Other SLMs operate on similar principles, with an 
array of display elements that may emit or reflect light 
simultaneously, such that a conplete image is gener- 
ated by addressing display elements rather than by 
scanning a screen. Another example of an SLM is a liq- 
uid crystal display (LCD) having individually driven dis- 
play elements. 

For all types of SLMs, motion displays are achieved 
by updating the data in the SLM 's memory ceils at suffi- 
ciently fast rates. To achieve intermediate levels of illu- 
minatioa between white (ON) and blad< (OFF), pulse- 
width modulation (PWM) techniques are used. The 
basic PWM scheme involves first determining the rate at 
which images are to be presented to the viewer. This 
establishes a frame rate and a corresponding frame 
period. For example, in a standard television system, 
images are transmitted at 30 frames per second, and 
each frame lasts for approximately 33.3 milliseconds. 
Then, the intensity resolution for each pixel is estab- 
lished. In a sinplG example, and assuming n bits of res- 
olution, the frame time is divided Into 2"-1 equal time 
slices. For a 33.3 millisecond frame period and n-bit 



intensity values, the time slice is 33.3/(2"-1) miHisec- 
onds. 

Having established these times, for each pixel of 
each frame, pixel intensities are quantized, such that 
5 black is 0 time slices, the intensity level represented by 
the LSB is 1 time slice, and maximum brightness is 2"- 
1 time slices. Each pixel's quantized intensity deter- 
mines its on-time during a frame period. Thus, during a 
frame period, each pixel with a quantized value of more 
to than 0 is ''ON " for the number of time slices that corre- 
spond to its intensity. The viewer's eye integrates the 
pixel brightness so that the image appears the same as 
if it were generated with analog levels of light. 

For addressing SLMs. PWM calls tor the data to be 
75 formatted into "bit-planes", each brt-plane correspond- 
ing to a bit weight of the intensity value. Thus, if each 
pixel's intensity is represented by an n-bit value, each 
frame of data has n bit-planes. Each bit-plane has a 0 or 
1 value for each display element. In the PWM sample 
80 desaibed in the preceding paragraphs, during a frame, 
each bit-plane is separately loaded and the display ele- 
ments are addressed according to their associated bit- 
plane values. Fa example, the bit-plane representing 
the LSBs of each pixel is displayed for 1 time slice, 
25 whereas the bit-plane representing the MSBs *rs <Ss- 
played for 2n/2 time slices. 

DMD-based digital display systems are described 
in further detail in U.S. Patent No. 5.079.544. entitled 
"Standard Independent Digitized Video System". il.S. 
30 Patent No. 5.526.051, entitled "Digital Television Sys- 
tem", and in U.S. Patent No. 5.452.024. entitled "DMD 
Display System", each assigned to Texas Instruments 
Incorporated. 

Recently, standards have been developed for 
35 advanced television <ArV), whose transmission signals 
are comprised of compressed digital data, which is 
decompressed at the television receiver. ATV includes 
tx)th standanj definition television {SDTV) and high def- 
inition television {HDTV). SDTV is the digital equivalent 
40 of today's analog television signals, and ischaracterized 
by interlaced format and a 4:3 aspect ratio. As com- 
pared to SDTV, HDTV is characterized by higher frame 
resolution, progressive format, and a 16:9 aspect ratio. 
The characteristics of both SDTV and HDTV are com- 
45 patible with the DMD technology, and an appropriately 
configured DMD-based system is capable of meeting 
HDTV bandwidth requirements. 



SUMMARY OF THE INVENTION 



so 



One aspect of the invention is a display system and 
method for displaying images based on an input signal 
carrying compressed video data. Such signals Indude 
both STV and HDTV signals. A signal interface receives 
55 the input signal and converts it to a bitstream of pixel 
data. A multiprocessor unit receives this pixel data and 
performs various processing tasks, which vary depend- 
ing on the display mode. The multiprocessor unit ^ a 
single device having a master processor and multiple 
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digital signal processors capable of operating in paral- 
lel. A primary processing function of the multiprocessor 
unit is decompression of pixel data. A scaling processor 
receives the decompressed pixel data and scales it ver- 
tically, horizontally, or in both directions, to a desired dis- 5 
play resolution. Then, picture quality unit receives the 
processed pixel data and converts its colorspace if it is 
not already RGB data, as well as reverses any de- 
gamma correction, thereby providing display-ready 
pixel data. A bit-plane buffer has formatting circuitry fbr 10 
formatting the display-ready pixel data into bit-plane for- 
mat and has menrxx-y cells for storing the data, tt deliv- 
ers the data in bit-plane format to three spatial light 
modulators (SLMs) that concurrently generate differ- 
ently colored images, which are combined fbr display of 15 
full color images. Other embodiments use either a sin- 
gle SLM that generates the differently colored images 
sequentially through a color wheel, or multiple SLMs 
that generate a comt^nation of concurrent ard sequen- 
tial images. 20 

An advantage of the invention is that it provides 
sharp, clear, exact-color, stable, and noise-free video. 
The system is entirely based on digital semiconductor 
technology. As more advanced digital inputs emerge, 
such as with MPEG-based digital video, the system 25 
excels with its ability to meet bandwidth requirements. 
Conrplex processing tasks can be allocated within the 
multiprocessor unit as needed for t>andv/idth require- 
ments. Also, data can be divided into channels for par- 
allel processing through the picture quality unit and Into 30 
the bit-plane buffer. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be further desaibed, 35 
by way of example, with reference to the accompanying 
drawings In which: 

FIGURE 1 is a block diagram of a digital image dis- 
play system In accordance with the Invention: 40 

FIGURE 2 illustrates the multiprocessor unit of FIG- 
URE 1; 

FIGURE 3 illustrates an example of partition of 4s 
tasks for compression decoding by the multiproces- 
sor unit of FIGURE 2; 

FIGURE 4 illustrates the serial video processor of 
FIGURE 1; and so 

FIGURE 5 illustrates the picture quality unit and bit- 
plane buffer of FIGURE 1. 

DETAILED DESCRIPTION OF THE INVENTION 55 

FIGURE 1 iDustrates an all-digitat image display 
system 10 in accordance with the invention. Display 
system 10 comprises a signal interface 11 , a multiproc- 



essor unit 12. a serial video processor 13, a prctuce 
quality unit 14, a bit franr^ buffer 15. a spatial light mod- 
ulator (SLM) 16, an optics unit 17, and a timing unit 18. 
The following description is primarily directed to multi- 
processor unit 12. to serial video processor 13. and to a 
configuration of system 10 to meet bandwidth require- 
ments for high resolution displays in various display 
modes. Multiprocessor unit 12 performs MIMD (multiple 
instruction multiple data) processing, whereas serial 
vkleo processor 13 performs SIMD <slngle Instruction 
multiple data) processing, with pixel processing tasks 
being allocated between them. 

Signal interface 11 receives digital input signals, 
such as the modulated digital bitstr«ams provkled by 
proposed high definition advarK;ed television starvlards. 
Signal interface 31 demodulates and txjffers the input 
signal, so as to provide compr.es&6d pixel data. MPU 12 
also interprets the input signal so as to provide audio 
arxj timing signals. Signal interface 1 1 has appropriate 
filters and memory for performing these tasks. The 
image data into signal interface 11 might come from a 
number of sources, including a television tuner for video 
data or a CD-ROM drive, a disk, or network fbr graphkss 
data. 

System 10 may be configured for any one of the 
advanced television (ATV) signals, including standard 
television (STV) or high definition television (HDTV) sig- 
nals. Furthermore, system 10 coukJ be configured for 
selection between two or more input signals having dif- 
ferent formats. If system 10 is to receive input signals 
having different formats, signal interface 1 1 provides a 
control signal to MPU 12 and to SVP 13 to indkate the 
format of the input signal so that ^ropriate program- 
ming is executed by these processors. Means for pro- 
viding such a control signal are descrbed in Published 
European Patent document No. 0.710,016. assigned to 
Texas Instruments Incorporated. 

Multiprocessor unit (MPU) 12 receives data from 
signal interface 11. This data is a bitstream of data 
packets, which may contain video, audio, or graphics 
information. As explained below in connection with FIG- 
URE 2. MPU 12 decompresses the data, tt may perform 
other tasks as appropriate to ttie input signal; «uch as 
progressive scan <x)nversion if tiie input signal is in 
interlaced format. MPU 12 may also provide an 
"upstream" signal for Interactive television applications. 
An example of a suitable MPU 12 is the MVP (Multime- 
dia V/kieo Processor). TMS320C80, manufactured by 
Texas Instruments Incorporated. 

A processing memory 12a stores pixel data as 
needed for processing by MPU 12. A first-in first-out 
(FIFO) memory 12b iDuffers data from MPiJ 12 to serial 
video processor (SVP) 13 to accommodate the SVP 
input structure. 

Serial vkleo processor <SVP) 13 receives the pixel 
data from MPU 12 and completes the processing nec- 
essary to prepare the pixel data for display. As 
explained below inconnection with FIGUf^ 3. the proc- 
esses periormed by SVP 13 includes horizontal and 
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vertical scaling. Scaling is the process of changing 
image resolution, with horizontal scaling changing the 
number of active pixels per line and vertical scaling 
changing the mtrber of active lines per frame. Exam- 
ples of devices suitable for SVP 13 are the SVP 
TMC57102 and Tf^C57l10. both manufactured by 
Texas Instruments Incorporated. 

Picture quality unit (PQU) 14 receives the deconv 
pressed and scaled pixel data from SVP 13 and per- 
forms tasks such as colorspace conversion and de- 
gamma. Color space conversion converts color differ- 
ence (YUV) data to RGB data. The data also undergoes 
a degamma process, which linearizes the RGB data by 
removing the effect of a gamma correction that is proc- 
essed into video signals at transmission. PQU 14 may 
also perform error diffusion when the pixel bit<tepth tor 
display is to be less than the pixel bit-depth of the trans- 
mitted signal. 

Bit-plane buffer 15 receives processed pixel data 
from PQU 14. tt formats the data into Tait-plane" format 
and delivers the bK-planes to SLMs 16 one at a time. As 
discussed in the Background, the bit-plane format per- 
mits each display element of SLM 1 6 to be turned 'ON ' 
or XDFF" in response to the value of 1 bit of data at a 
time. As explained below in connection with FIGUf^E 5. 
this formatting is performed by hardware associated 
with bitiDlane buffer 15. 

In a typical display system 10. bit-plane buffer 15 
has a "double buffer" memory, which means that it has 
a capacity for at least two display frames. The buffer for 
one display frame can be read out to SLMs 1 6 while the 
Ixjffer for another display frame is being written. The two 
buffers are controlled in a "ping-pong" manner so that 
-data is continuously available to SLMs 16. 

The bit-plane data from bit-plane buffer 15 is deliv- 
ered to SLMs 16. Details of a suitable SLM 16 are set 
out in U.S. Patent No. 4,956.619. entitled "Spatial Light 
Modulator", whrch is assigned to Texas Instruments 
Incorporated. Essentially, SLMs 16 use the data from 
bit-plane buffer 15 to address each display element of 
its display element array. The "ON" or "OFF" state of 
each display element forms an image. During a frame 
period, each SLM 16 generates an image for a different 
color (red. green, and blue) of a picture. The images tbr 
each frame are concurrently displayed and conrtoined to 
form a color picture. 

Preferably. SLMs 16 have a display element anray 
size that is at least as large as the resolution of the sig- 
nal to be displayed. For example, lor HDTV, full trans- 
mission resolUion is 1920 x 1080 pixels. To match this 
resolution, SLMs would have an an-ay size at least this 
large. However, an input signal having a different hori- 
zontal or vertical resolution can be upscaled or downs- 
caled to fit the SLM size in either or both dimensions. 
Display optics unit 17 has optical components for illumi- 
nating SLMs 16 and for receiving the image from SLMs 
16. These components include a light source, lenses, 
and a zoom projection lens. 

The three SLMs 16 of FIGURE 1 provide color 



images by concurrently displaying images of three pri- 
mary colors. In other embodiments, there could be only 
a single SiM and differently colored images would be 
displayed sequentially through a color wheel. The eye 
5 would then integrate the sequential images to form a 
colored picture. Still other embodiments use two SLMs 
with images of different colors being either sequential or 
combined. 

Master timing unit 18 provides various system-coh- 
10 trol functions. Timing unit 18 may be implemented wHh 
afieb programmable gate array (FPGA). to handle dif- 
ferent frame resolutions and frame rates. 

MULTIPROCESSOR UNIT 

15 

FK3URE 2 is block diagram of MPU 12. As stated 
above, a suitable MPU ^^ is the TMS320C80 MVP, 
manufactured by Texas Instruments lr>corporated. 
Other multiprocessor units hiaving similar characteris- 

20 tics could be substituted. In addition to the structural 
characteristics described below, an important functbnal 
characteristic of MPU 12 is the ability to perform decom- 
pression of input data at rates required for full motion 
video. To this end. the MVP is capable of performing 2 

25 bBlion RISC-like operations per second (BOPs). The 
internal data memory transfer bandwidth is 2.4<Bbytes 
per second and the external data transfer bandwidth is 
400 Mbytes per second. 

MPU 12 has a set of parallel signal processors 21, 

30 a master processa 22, and RAM (random access 
memory) 23. All processors 21 and 22 are programma- 
ble. The processors 21 and 22 access RAM 23 via a 
aossbar switch 24. The crossbar switch -24 intercon- 
nects the processors 21 and 22 in a manner such that 

35 different combinations of memory arrangements can be 
achieved as necessary for the particular opera^on. 

The master processor 22 is a 32-bit RISC ^reduced 
instruction set computer) processa with a f k>ating point 
hardware unit (FPU). It has an instruction (I) port to 

40 access an instruction cache in RAM 23. It coordinates 
the processing by the signal processors21 and commu- 
nicates with other components of system 10. 

The parallel signal processors 21 are 32'bit integer 
units. Each signal processor 21 has a global<G) and a 

45 local (L) port to access RAM ^3. and an instruction <l) 
port to access an instruction cache in RAM 23. -Each 
signal processor 21 has two address generators, a 
three-input ALU. and a dock multiplier, all controlled 
with 64-bit instructions. 

so The crossbar switch 24 localses the high band- 
widths necessary for decompression algorithms. It 
thereby avoids high external bandwidth requirements. 

A video controller 25 has dual frame timers, for dif- 
ferent input and output frame rates Transfer controller 

55 2B is a direct memory access device, used for cache 
servicing and transferring blocks of data on or off multi- 
processor unit 12. 

RAM 23 is 50K bytes of single-cycle memory, 
divided into 25 2K-byte RAM units. Each processor 51 
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and 22 has one RAM unit partially decBcated to storing 
interrupt vectors addresses and specifying parameters 
to the transfer controller 26. Each signal processor 21 is 
three data RAM units that any processor 21 or 22 can 
access as shared mennory. Each signal processor 21 
has one instruction cache RAM unit and the master 
processor 22 has two instruction cache RAM units. 
These RAMS are mar^ged by an instruction cache con- 
troller in each processor. The master processor 22 also 
has two RAM units that for data, managed by a data 
cache controller. 

Further details describing the MVP are set out in 
U.S. Patent No. 5.212,777. entitled "Multi-Processor 
Reconfigurable in Single Instruction Multiple Data 
^SIMD) and Multiple Instruction Multiple Data (MIMD) 
Modes and Method of Operation", assigned to Texas 
Instruments Incorporated. Additional information is 
available in various MVP User's Guides, available from 
Texas Instruments. 

A primary task of MPU 12 is decompression of the 
pixel data. It may be programmed to support various 
conpression standards, such as the JPEG, MPEG. 
MPEG2. Px64, CCITT, etc. This programming can be 
for either still and full motion decompression algorithms. 
A multi-format MPU 12. asdescrbed in Published Euro- 
pean Patent document No. 0.710.016 can be switchable 
between decompression algorithms, so as to perform 
whatever decompression method is appropriate for the 
irput signal. As stated above, if signal interface 11 is 
capable of detecting the signal type, it delivers a control 
signal to MPU 12. MPU 12 operates on multidimen- 
sional blocks of data, such as the 8x8 and 16x16 blocks 
of data called for by the MPEG standard. 

Decompression of MPEG encoded data using an 
MVP is described in U.S. Patent No. 5.420.809. entitled 
'Huffman Decoding Method, Circuit, and System 
Employing Conditional Subtraction for Conversion of 
Negative Numbers", assigned to Texas Instruments 
Incorporated. 

FIGURE 3 Illustrates an example of task allocation 
for a decompression process performed by MPU 12. 
Master processor 22 acts as a "server" to allocate tasks 
to the four DSPs 21 . Tasks are queued to each DSP 2T. 
A first DSP 21 performs variable length decoding for 
variable length coded (VLC) data. Its output is queued 
to the other three DSPs 21 . which perform, in parallel, 
inverse disaete transfomn (IDCT) and pixel reconstruc- 
tion. Thus, as exemplified by FIGURE 3. a less time 
consuming task can be performed by one DSP with 
more complicated tasks being partitioned among other 
DSPs. This permits all necessary processing to be per- 
famed within required bandwidth requirements for high 
resolution full motion video display. 

If the input data is interiaced. MPU 1 2 performs pro- 
gressive scan conversion. In this process. MPU 12 gen- 
erates new data to fill in odd lines of even fields and 
even lines of odd fields. The particular progressive scan 
«)nversion algorithm to be performed may depend on 
whether the picture is in nwtion or still. The motion sig- 



nal embedded in the<x)mpre5sed data signal could be 
used to control whk:h algorithm is performed. 

MPU 12 can also be progranuned to generate 
graphics displays when the input signal carries graphics 

5 data. If the graphics display requires intensive process- 
ing. MPU 12 and bit-plane buffer TScouW be configured 
so that MPU 12 generates a portion of a frame every 
frame period. For example, during a first frame period, 
MPU might generate the top portion of an inriage. During 

10 the next frame period. MPU 12 would generate the txrt- 
tom portion. The portions are updated in alternating 
. frames. An .appropriate control signal to buffer 15 
ensures that data is delivered to the proper memory 
space. For graphrcs displays that are .already in RGB 

15 format. MPU ^2 can deliver the graphics data dir^y to 
bit-plane buffer 15 

MPU 12 may also perform decoding and process- 
ing for "secondary" video displays, such as picture-in- 
picture or multiple picture displays. For multiple picture 

20 displays, MPU 12 could receive multiple channels from 
interface 11 and perform the necessary scaling. For 
secondary displays. MPU 12 would deliver the image 
data to PQU 14 for colorspace conversion and de- 
gamma if necessary. 

25 Because MPU 1 2 is programmable, itcan store and 
execute algoritfims for any of these various display 
"nxxdes". The images generated for the different modes 
can be generally categorized into "main" video images, 
"secondary" video images, and graphics images. Each 

30 mode can have its own set of algorithms, which are 
called and executed In accordance with a^ntrol signal. 

MPU 12 can be programmed to receivecommands 
from a user, via an Input device such as a rernoXe con- 
trol keypad. Hcan be programmed to prepare this user 

35 input data for upstream transmission for interactive tele- 
vision applk^tions. 

To meet bandwkfth requirements for a main video 
display, all signal processors 2^ may usually be per- 
forming decompression. However, when other modes 

40 are called for. such as a secondary video display, one 
signal processor 21 could be switched to that task, per- 
haps at the expense of resolution or update rate of the 
main image. 

In the embodiment of 'FIGUf=?E 1, colorspace con- 
45 version is performed by PQU 14. However, it would also 
be possible to program MPU 12 to perform colorspace 
conversion. Subsequent processing wouW then operate 
on RGB data. Because RGB data has a higher band- 
width than does YUV data, appropriate modifications 
50 may be necessary to fit the data to the input structure of 
SVP 13, such as by downscaling the horizontal resolu- 
tion. 

SERIAL VIDEO PRCX^ESSORtSVP) 

55 

FIGURE 4 is a block diagram of SVP 13. As stated 
above, examples of suitable SVP processors are the 
SVP TN/tC57102 or the TMC57110, programmatte 
processors manufactured by Texas Instruments Incor- 
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porated. However, system 10 Is not necessarily limited 
k) use with this particular SVR and variations of the 
SVP may be used. A particular characteristic of SVP 13 
is that it operates on rows of pixel data on a row-by-row 
basis. In alternative embodiments, SVP 13 could be 
replaced with a special scaling processor, such as the 
ACUITY device commercially available from Genesis 
Miaochip Incorporated. 

The "serial video" aspects of SVP 13 derive from * 
the fact that it Is particularly suited for video processing, 
vrtiere discrete packets of incoming data, which have a 
uniform size, are input arKJ output in a word-serial man- 
ner but are processed in parallel. It receives and proc- 
esses data vectors in synchronization with a real time 
data source. Essentially, SVP 1 3 operates by using f ine- 
grained parallelism techniques in which many process- 
ing elements operate on the data concurrently. 

SVP 13 Is a general purpose, mask-programmable, 
single-instruction nrultiple-data (SIMD). reduced 
instruction set corrputing (RISC) device. Consistent 
with the SIMD characteristic. SVP 13 has a number of 
processing elements (PEfe), which execute the same 
instruction at the same time. External micro-instructions 
control primitive togic and arithmetic functions for each 
clock cycle. 

SVP 13 is a one-dimensk)nal array of one-bit FE%. 
A vertical slice through SVP 13 of FIGURE 4 yields an 
individual PE. thus each PE (1) and its components are 
r^fenred to herein as a "column" with respect to the 
entire array of SVP 13. Each PE has the following basic 
components: a data input register (DIP) 41, two inde- 
pendently addressed register files (RQ and R1) 42 and 
45. a set of vworking registers ( WR s) 43, a one-bit arith- 
metic unit (ALU) 44. and a data output register (DOR) 
46. 

DIR 41 can be thought of as the "input layer," RO 42 
and R1 45. the WR's 43. and the ALU 44 are the "com- 
putational layer." DOR 46 is the output layer." Although 
each layer may be independently clocked across each 
layer, all PE s operate in unison, every clock cycle. The 
input to DIR 41 is word-serial in the sense that words of 
an incoming packet of data are received Into DIR 41 
word by word. Similarly, the output from DIR 46 is word- 
serial. 

Although Input and output are word-serial, process- 
ing of each data packet is parallel. Also, because of the 
"layered" approach to processing, data input, computa- 
tion, and data output may be concurrent operations, 
with each being independently clocked. Each PE per- 
forms these operations on an entire vector of data at 
once, and Is thus a "pipeline" that enables several oper- 
ations to be in various stages at once. When a vector 
instruction is executed, the elements of the vector are 
fed into the appropriate pipeline one at a time, delayed 
by the time it takes to complete one stage of the pipe- 
line. Irput and output are in synchronization with the 
data source, such as a video camera, and with the data 
sink, such as a raster scan display. 

For purposes of Illustration, SVP 13 has N number 



10 

of PE s, where N • 1440. The memory size Is 256 bits for 
each PE, with 128 bits each for RO and R1 . OIR 41 is 40 
bits wide, and DOR 46 is 24 bits wide. These sizes are 
discretionary, however, and may be changed without 
5 changing the subsitance of the invention. The irput and 
output bit sizes are included in FIGURE 4 to illustrate 
various input/output and device size relationships. How- 
ever, these bit sizes may be varied accoiding to the 
application. 

10 Using these values, a single SVP 13 can process 
data packets of 1 to 1 440 words by 40 bits. Typically, tfie 
packets are equal in size and represent. periodicaity. 
recurring data, such as lines of a television image, 
where each packet is digitized into N number of data 

75 samples, and where each sample. S(l). I s 1 ... N. is a 
data word used to generate an output word. In televiskin 
applications, where SVP 13 has N PE's, N also repre- 
sents the number of data samples per line. 

DIR 41 and DOR 46 are the basic I/O devices of 

20 SVP 13. Both DIR 41 and DOR 46 are arrays of sequen- 
tially addressed, dual-ported memory cells. As used in 
this description. "DIR 41" refers to the entire anay. and 
"DIR 41(1)" refers to the column of DIR 41 that receives 
data sample S(l). 

£5 The input array size to SVP 13 permitted by DIR 41 
is 1440 words x 40 bits. One port of DIR 41 \s organized 
as 1440 words of 40 bits each and permits DIR 41 to be 
written into from a 40 bit input line in parallel. Thus, this 
first port of DIR 41 emulates the write port of a 1440- 

30 word line memory, whkh permits word-serial input. The 
second port of DIR 41 is organized as 40 words of 1440 
bits each, where each bit corresponds to a PE(I). This 
second port provides an interiace between DIR 41 and 
PE 's. It is physically a part of. and Is mapped Into, the 

3S absolute address space of RO 42. This permits the con- 
tents of DIR 41 to be addressed for selection to write 
into memory and is read in parallel. 

Uke DIR 41 . DOR 46 is a two port device. In a man- 
ner similar to DIR 41, it provkles 1-bit access to each 

40 ALU 44(1) and 24-bit output from SVP 13. One port of 
DOR 46 is organized as 1440 words of 24 bits each. 
This port functionally enulates the read port of a 1440- 
word line mentory and is used for word-serial output. 
The second port of DOR 46 is organized as 24 words of 

45 1 440 bits each, where each bit corresponds to a PS(I). 
This second port couples to R1 45. and Is written to in 
parallel. 

DIR 41 and DOR 46 each have a 1440-blt word 
selection commutator, which controls loading to and 
so reading from DIR 41 and DOR 46. respectively. Also. 
DIR 41 and DOR 46 each have an enable and resetsig- 
nal. 

RO 42 and R1 45 each have 128 words by 1 bit of 
read/write memory per PE. Different addressing struc- 
55 tures cover ttne RO 42 and R1 45. However. RO 42 and 
R1 45 share the same control and timing circuitry. RO 42 
and R1 45 are comprised of random access memory 
(RAM) cells. If dynamic RAM cells are used, they must 
be refreshed, but typical digital television applications 
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perform the refresh by operating in a faster cycle time 
than the required refresh period. 

Each RO 42(1) and R1 45 (I) is independently 
addressable, and is capable of 10 bit read-modify-wrrte 
cycle such that it can be read, the data operated on by s 
ALU 44. and the result written back to it in a single dock 
cycle. RO 42 and Rl 45 read data at the same time, but 
write separately 

The working register (WR) set 43(1) for each PE(I) 
comprises four registers: M, A. B, and C. These regis- io 
ters are the same, except tor their data sources and 
destinations. Each WR 43(1) is associated with an Input*-, 
multiplexer for providing data to the four inputs of each 
ALU 44(1). The M register is used for division, multiplica- 
lion. and togical and conditional operations. Registers is 
A, B. and C are addend, minuend, and carry/borrow 
registers, respectively. 

ALU 44 is a simple full adder/subtracter and a one- 
bit multiplier. The inputs to ALU 44 are from the WR s 
43. These ALUs carry out whatever instruction is speci- 20 
tied by the control unit of SVP 13. A feature of SVP 13 is 
that each ALU 44 executes instructions from a set of 
instructions that operate on data directly. A separate 
•control unit (not shown) which feeds an instruction 
stream to SVP 13 has an additional set of instructions 2S 
that provide basic execution control. 

In the example of tNs description, it is assumed that 
SVP 13 has sufficient PE 's to process one line of pixels, 
where each PE corresponds to one pixel of a tine of 
video data. If not. the data can be decimated to fit the 30 
SVP 13, An interpolation processor (not shown) can be 
added to regenerate the number of pixels required for 
display. 

SVP 1 3 performs scaling tasks. If the incoming data 
has a smaller vertical or horizontal resolution than 55 
SLMs 16 it may be upscaled to maximize the number of 
active SLM display elements to obtain bright high-reso- 
lution display. Also, the data can be downscaled. verti- 
cally or horizontally, to match the signal and display 
resolutions. 40 

Examples of methods of performing scaling with an 
SVP are described in U.S. Patent No. 5,526.051 and in 
European Patent Putrfication No. 0.710.016. The meth- 
ods described therein include bi-linear and cubic scal- 
ing for 2:3. 3:4. and 9:10 scale factors. 45 

PICTURE QUALITY UNIT AND BIT-PLANE BUFFER 

FIGURE 5 illustrates one embodiment of PQU 14 
and bit-plane buffer 15. As explained below, the pixel so 
data is divided into channels, where each channel con- 
tains a portion of a row of pixel data. This facilitates 
meeting bandwidth requirements for high resolution dis- 
plays. 

As stated above. PQU 14 performs color space ss 
conversion, de-gamma, and error diffusion. YUV data is 
delivered to a 3x3 matrix multiplier, where color space 
conversion is performed. Data that is received as RGB 
data bypasses the colorspace conversion. If the data 



has been gamma corrected, PQU 14 performs a de- 
gamma process by means of a look-up table. Appropri- 
ate colorspace conversion and de-gamma processes 
are described in U.S. Patent No. 5.526.051. Gamma 
oon'ection is necessary iDecause a gamma curve is 
introduced into the standard video signal to compensate 
for a nonlinearity in a CRT However, system 10 has 
SLMs 16, which have a linear response. The quality of 
the display is improved by removing the effect of the 
unneeded gamma curve. PQU 14 may be implemented 
as an application spedfk; integrated circuit (ASIC). For 
larger SLM resolutions, multiple ASICs are used, such 
that two or more channels of data are processed in par- 
allel. European Patent Application No 96120656.2. 
assigned to Texas Instruments Incorporated, describes 
an example of an ASIC for implementing PQU 14. 

In the example of FIGURE 5. PQU 14 have five 
ASICs, each for processing one of five channels of data. 
Each ASIC contains a matrix multiplier for color space 
conversion, a de-gamma LUT. and FIFO's for delivering 
data to bit-plane buffer 15. 

Bit-plane buffer 15 is comprised of DMDRAMs. 
which are also an applkation specific device <ASIC). 
Examples of suhatiie DMDRAf^ are descrtoed in US. 
Pat. Serial No 08/160.344. entitled "Digital Memory for 
Display System Using Spatial Ught Modulator", and in 
U.S. Pat. Serial Na 08/333. 199. entitled "Memory Archi- 
tecture for Reformatting and Storing Display Data in 
Standard TV and HDTV Systems", both assigned to 
Texas Instruments Incorporated. The DMDRAMs 
described therein have a format on output feature and a 
format on input feature, respectively. 

To meet bandwidth requirements for pixel data 
ranging from 9 to 12 bits per pixel and an SLM display 
size of 2048 x 1152 pixels, bit-plane buffer 15 has 30 
DMDRAMs. 10 for each SLM 16. Each SLM 1« is dou- 
ble-buffered so that one buffer can be filled while the 
other is delivering data to the SLM. Therefore, tor each 
SU^ 16. the 10 DMDRAMs comprise two buffers having 
five DMDRAMs each. Each DMDRAM has 24 input pins 
and 27 output pins. Each DMDRAM has sufficient 
capacity for providing data for 432 pixels per row and 
1 1 52 rows. Each output pin delivers data to a t64)it shift 
register at the input of its SLM 16. Thus, a 27 bit output 
pin is capable of delivering 27' 16 » 432 bits, one bit per 
column of its SLM 16. As indicated in FIGURE 5. for a 
display size of 2046 pixels per row. not aD of the output 
pins are used. 

To provide the pixel data to bit-plane buffer IS. PQU 
14 is configured to process five channels of RGB data in 
parallel. The channels split the data across aach row. 
such that each channel consists of 25 or -26 columns of 
RGB data Each of five PQU ASICs processes one 
channel, and delivers its RGB data to the appropriate 
red. green, or blue DMDR/\M. 

In addition to. or as an alternative to, dividing data 
into columns, the channels could process different rows 
in parallel. For example, three PQU ASICs could each 
process a differ^t line of pixel data. The DMDRAMs of 
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bit-plane buffer 1 5 would be grouped to receive different 
rows in parallel. Thus, a first DMDRAM might receive 
row r. a second DMDRAM woM receive row r+1 , a third 
would receive row r+3. This process is further described 
in European Patent Application No. 96120656.2. 5 

Although the present invention has been described 
In detail, it should be understood that various changes, 
substitutions, and alterations can be made hereto with- 
out departing from the spirit and scope of the invention. 

10 

Claims 

1 . A display system for displaying images based on an 
input signal carrying compressed image data, com- 
prising: 

a signal interface for receiving said input signal 
and for providing a compressed bitstream of 
pixel data; 

a multiprocessor unit for receiving said pixel so 
data from said signal interface, said multiproc- 
essor unit having a master processor and mul- 
tiple digital signal processors capable of 
operating in parallel, said multiprocessor unit 
being programmed to perform decompression 2S 
of said pixel data, thereby providing decom- 
pressed pixel data; 

a scaling processor for receiving said decom- 
pressed pixel data from said multiprocessor 
unit said scaling processor being programmed 30 
to scaJe said decompressed pixel data to a 
desired display resolution, thereby providing 
processed pixel data: 

a picture quality unit for receiving said proc- 
essed pixel data from said scaling processor. 35 
said picture quality unit having circuitpy 
an-anged to reverse any de-gamma correction 
on said processed pixel data, thereby providing 
display-ready pixel data; 

a bit-plane buffer for receiving said display- 40 
ready pixel data, said bit-plane having format- 
ling circuitry for formatting said display-ready 
pixel data into bit-plane format, and having 
memory cells for storing said display-ready 
pixel data; and 

at least one spatial light modulator (SLM) for 
generating images based on said display- 
ready pixel data in said bit-plane format. 

2. The display system of Claim 1 . wherein said multi- so 
processor unit is programmed to execute different 
algorithms depending on the type of said input sig- 
nal. 

3. The display system of Claim 1 or Claim 2. wherein 55 
said multiprocessor unit allocates decompression 
tasks among said digital signal processors. 

4. The display system of any preceding claim, wherein 



said multiprocessor unit is programmed to perform 
progressive scan conversion if said input signal is 
interlaced. 

5. The display system of any preceding claim, wherein 
said input signal carries graphics data and said 
multiprocessor unit is programmed to render graph- 
ics images from said graphics data. 

6. The display system of Claim 5. wherein said mulli- 
processor unit is programmed to render alternating 
portions of one or . more. of. the graphics image in 
alternating frame periods 

7. The display system of any preceding claim, vwherein 
said multiprocessor unit is programmed to receive 
user input data and to prepare said user input data 
tor upstream transmission. 

8. The display system of any preceding claim, wherein 
said scaling processor is a serial video processor 
(SVP) having an input register, a number of 
processing elements, and an output register. 

9. The display system of any preceding claim, wherein 
said picture quality unit operates on multiple chan- 
nels of said pixel data. 

10. The display system of Claim 9, wherein each of 
said channels contains a portion of Bach row of said 
pixel data. 

11. The display system of Claim 9 or Claim 10, wherein 
said bit-plane buffer is organized to receive said 
channels in parallel. 

1 2. The display system of any preceding claim, wherein 
the or each spatial light modulator is capable of 
generating different coloured images. 

13. The display system of Claim 12, wherein said at 
least one SLM is a single SLM that generates said 
differently colored images sequentially and wherain 
said display system further comprises a color 
wheel. 

14. The display system of Claim 12, wherein sad at 
least one SLM is two or more SLMs that generate 
differently colored images concurrently. 

1 5. The display system of any preceding claim, wherein 
said bit-plane buffer formats said d'tsptay-r^ady 
pixel data on Input. 

16. The display system of any of Claims 1 to 14. 
wherein said bit-plane buffer formats said display- 
ready pixel data on output 

17. The display system of any preceding claim further 
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comprising: 



a timing unit for delivering timing signals to said 
multiprocessor unit, said scaling processor, 
said bit-plane buffer, and said at least one s 
SLM. 

18. The display system of any preceding claim, wherein 
the picture quality unit is further arranged to convert 
the colorspace of said processed pixel data if said io 
processed pixel data is not RGB data. 



19. The display system of any preceding claim, wherein 
the display system is an all-digital display system. 

20. A method for displaying images comprising: 



receiving an input signal carrying compressed 
image data to provide a compressed bitstream 
of pixel data; 20 
perfornning a deconrpression of said com* 
pressed bitstream of pixel data to provide 
decompressed pixel data; 
scaling the deconrpressed pixel data to provide 
processed pixel data of a predetermined dis- 2S 
play resolution; 

reversing de-gamma coaection of said proc- 
essed pixel data, to provide display-ready pixel 
data; 

formatting said displaynready pixel data into a 30 
bitiDlane format: and 

generating images based upon said formatted 
display-ready pixel data. 

21. The method of Claim 20 further comprising the step ss 
of: 



converting the colorspace of said processed 
pixel data H said processed data is not RGB 
data. 40 
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